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DETAILED ACTION 

Continued Examination Under 37 CFR 1.1 14 

1. A request for continued examination under 37 CFR 1.114, including the fee set forth in 37 
CFR 1.17(e), was filed in this application after final rejection. Since this application is eligible for 
continued examination under 37 CFR 1.114, and the fee set forth in 37 CFR 1 .17(e) has been timely 
paid, the finality of the previous Office action has been withdrawn pursuant to 37 CFR 1.114. 
Applicant's submission filed on April 28, 2008 has been entered. 

Response to Amendment 

2. Applicant's amendment filed on March 19, 2008 has been considered and entered in full. 

3. Applicant's amendment to the abstract has been entered and is persuasive. 

4. Applicant's arguments with respect to amended claims have been considered but are moot in 
view of the new ground(s) of re)ection(s) made below. 

Claim Rejections - 35 USC § 112 

5. The following is a quotation of the second paragraph of 35 U.S.C. 1 12: 

The specification shall conclude with one or more claims particularly pointing out and distinctiy claiming the subject 
matter which the applicant regards as his invention. 

6. Claims 17-22 recites the limitation "wherein the external sources comprise one or more 
of:. . .". There is insufficient antecedent basis for this limitation in the claim, especially for the term 
"external sources", as these claims are dependent claims depending on their base claims. However, 
for the examination purposes, "external sources" is interpreted as external context data. 



Application/Control Number: 1 0/821 ,800 Page 3 

Art Unit: 2624 

Claim Rejections - 35 USC § 101 
1. 35 U.S.C. 101 reads as foUows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of matter, or any 
new and useful improvement thereof, may obtain a patent therefor, subject to the conditions and requirements of 
this title. 

The USPTO "Interim Guidelines for Examination of Patent Applications for Patent 
Subject Matter Eligibility" (Official Gazette notice of 22 November 2005 
<http:/ /www.uspto.gov/web/ offices/ com/ sol/ og/ 2005/week47/ og200547.htm>). Annex 
IV, reads as follows: 

In contrast, a claimed computer-readable medium encoded with a computer program is a 
computer element which defines structural and functional interrelationships between the 
computer program and the rest of the computer which permit the computer program's 
functionality to be realized, and is thus statutory. See Lowry, 32 F.3d at 1583-84, 32 USPQ2d 
at 1035. 

Claims that recite nothing but the physical characteristics of a form of energy, such as a 
frequency, voltage, or the strength of a magnetic field, define energy or magnetism, per se, 
and as such are nonstatutory natural phenomena. O'Reilly, 56 U.S. (15 How.) at 112-14. 
Moreover, it does not appear that a claim reciting a signal encoded with functional 
descriptive material falls within any of the categories of patentable subject matter set forth in 
Sec. 101. 

... a signal does not fall within one of the four statutory classes of Sec. 101. 

. . . signal claims are ineligible for patent protection because they do not fall within any of the 

four statutory classes of Sec. 101. 
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8. Claims 9-16 and 20-22 are rejected under 35 U.S.C. 101 because: 

Claims 9-16 and 20-22 are drawn towards a computer-readable medium having a computer 
program or instructions embodied thereon. Such computer executable programs are functional 
descriptive material that can constitute statutory products when properly claimed in combination 
with a computer readable storage device that allows the functionality of the program to be realized. 
However, while the claim defines the program in combination with a "computer usable medium," 
the claim language is not limited to the use of tangible storage media in combination with the 
program. Specifically, the disclosure defines the computer accessible/readable medium as including 
read only memory (ROM); random access memory (RAM); magnetic disk storage media; optical 
storage media; flash memory devices; electrical, optical, acoustical or other form of propagated 
signals (e.g., carrier waves, infrared signals, digital signals) (paragraph 0020 on page 9 of the 
specification). While the read only memory (ROM); random access memory (RAM); magnetic disk 
storage media; optical storage media; flash memory devices (statutory media) are physical storage 
devices, but the carrier wave/infrared signal/digital signal is a signal which is intangible energy, and 
therefore is not considered to be a statutory product. While the claim does read on at least some 
statutory embodiments (such as the floppy or hard or magnetic or optically readable disks), it also 
encompasses the combination of the program with the carrier wave, which is not a statutory 
product. Since the claimed invention encompasses non-statutory embodiments, the claim is directed 
towards non-statutory subject matter. 

Claims 9-16 and 20-22 as a whole define a carrier wave, and "[a] transitory, propagating 
signal ... .is not a "process, machine, manufacture, or composition of matter." Those four categories 
define the explicit scope and reach of scope and reach of subject matter patentable under 35 U.S.C § 
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101; thus, such a signal cannot be patentable subject matter." (In re Pefms A.C.M. Nutyen; fed Cir, 
2006-1371, 9/20/2007). 

Because the fuU scope of the claim as properly read in light of the disclosure encompasses 
non-statutory subject matter, the claim as a whole is non-statutory. The examiner suggests amending 
the claim to include the disclosed tangible computer readable media such as "computer readable 
storage medium", while at the same time excluding the intangible media such as signals, carrier waves, 
etc. Any amendment to the claim should be commensurate with its corresponding disclosure. 

Claiin Rejections - 35 USC § 102 

9. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public use or on sale in 
this country, more than one year prior to the date of application for patent in the United States. 

10. Claims 1-2, 4-5, 7-10, 12-13 and 15-22 are rejected under 35 U.S.C. 102(b) as being 
anticipated by Hatfield et al., November 30, 1997, "An Interface integrating eye ga2e and voice 
recognition for hands-free computer access" (p?igcs 1-7). 

Hatfield discloses an EVA (Eye/ Voice Aware) interface which allows combined eye- tracking 
and voice input to allow hands-free interaction with a standard window-based computer application, 
where voice input being the external context data. 

Hatfield discloses "In EVA, we implemented a mode of operation where the user can slave the 
screen cursor to his/her eye. Wherever the user looks on the display while operating in this mode, 

the cursor wiU be displayed... The user fixates a Windows button The system will detect rapid 

eye movement, e.g., saccades and adjust very quickly to gross changes in POG "(Hatfield, topic 4 - 
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Initial EVA Implementation, pages 4 and 5). Clearly from Hatfield's disclosure, it is clear that the 
cursor is a slave of the eye, and the cursor motion is defined by the eye movement (or eye tracking 
data) and it being apparent that in order to interpret the eye motion (or eye tracking data), an eye 
interpretation engine (or system or component) is inherently required which would send the 
translated data to the system to synchronize the cursor with the eye motion (or eye behavior), 
without which EVA system won't be able to synchronize the eye with cursor. The interpretation 
component is a must part of a system which uses eye motion or eye behavior to control a system. 
Thus, EVA system, receiving from an eye interpretation engine, at least an interpretation of 
eye tracking data corresponding to at least one user. 

Hatfield further discloses receiving external context data corresponding the at least one 
user's interaction with an application (Topic 4 - Initial EVA Implementation- pages 4 and 5 - 
external context data being voice commands such as "forward tab", "click", "page up" and "page 
down" - With IE users can navigate the various hyperlinks in a web page by "tabbing between 
them" with the command "forward tab". They can also fixate a particular hyperlink and utter 
"cUck", page 4 -last few Unes). Now, as in Microsoft Windows, the operations of the computing 
device running the application are controlled by the use of cursor and the buttons, and controlling 
the system is basically controlling the operational state of the processor of the computing device. 
Hatfield discloses that voice input is used as command entry for controlling the operational states of 
the processor of the computer running the application. For example, voice commands such as 
"forward tab, "page up" and "page down" would control the operational state of browsing of 
internet explorer in the device (pages 4, last few Unes through page 5), which conforms to the 
limitation "wherein the external context data is related to an operational state associated with a 
computing device running the application". 
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Hatfield fiirther discloses "based, at least in part, on the interpretation of the eye tracking 
data and the external context data, dynamically acting on a characteristic of the application" (Topic 4 
- Initial EVA Implementation - page 4. last few Hnes through page 5 - in internet explorer, fixate a 
particular hyperUnk and utter "click" which has the effect of cHcking with a mouse on the hyperlink, 
thus hyperUnk being the characteristic of the application (internet explorer) and dynamically acting 
on the characteristic being clicking on the hyperlink to invoke the internet explorer to display the 
contents of the link on the browser). 

Regarding claim 2, claim 2 recites wherein acting on comprises one of: modifying, creating, 
destroying, removing, invoking and configuring. Hatfield discloses "in internet explorer, fixate a 
particular hyperlink and utter "cHck" which has the effect of clicking with a mouse on the 
hyperlink", (Topic 4 - Initial EVA Implementation - page 4. last few lines through page 5), thus 
hyperlink being the characteristic of the application (internet explorer) and dynamically acting on the 
characteristic being clicking on the hyperlink to invoke the internet explorer to display the contents 
of the link on the browser. 

Regarding claim 4, all the limitations in the claim 4 are similar to claim 1 except that claim 4 
recites "dynamically acting on an output of the application based, at least in part, on the 
interpretation of the eye tracking data and the external context data". As discussed before, Hatfield 

discloses (Topic 4 - Initial EVA Implementation - page 4. last few lines through page 5 - in internet 
explorer, fixate a particular hyperUnk and utter "cUck" which has the effect of clicking with a mouse 
on the hyperlink) thus hyperUnk being the characteristic of the appUcation (internet explorer) and 
dynamically acting on the characteristic being clicking on the hyperlink to invoke the internet 
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explorer to display the contents of the link on the browser. Thus clicking on the hyperlink would 
invoke the internet explorer to display the contents of the Unk as output on the browser, where the 
output again being a page in the internet explorer with hyperlink. Hatfield further discloses acting on 
the output (page 5, topic 4, T' few Knes - Users can also scroU the browser by issuing "page up" and 
"page down" commands, open list boxes and select various items). 

Claim 5 has been similarly analyzed and rejected as per claim 2. 

Claims 7-10, 12-13 and 15-16 have been similarly analyzed and rejected as per claims 1-2 and 

4-5. 

Regarding claims 17-22, Hatfield discloses the external sources (external context data) 
comprise one or more of: system information, location and/or z-order of windows and/or objects, 
document Object Model (DOM) of a Web page or application being viewed, current application 
process state and/or visual state, task models, cognitive models describing the mental or physical 
steps or states required (page 4 - last few Hnes - current application process state and/or visual 
state - tabbing between the hyperlinks which being the process/visual state of browsing, the tasks 
model including tabbing and scrolling, fixating and cUcking a windows button). 

aaim Rejections - 35 USC § 103 

11. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness 
rejections set forth in this Office action: 
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(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in section 
102 of this title, if the differences between the subject matter sought to be patented and the prior art are such that the 
subject matter as a whole would have been obvious at the time the invention was made to a person having ordinary 
skill in the art to which said subject matter pertains. Patentability shall not be negatived by the manner in which the 

12. Claims 3, 6, 11 and 14 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Hatfield et al., November 30, 1997, "An Interface integrating eye gaze and voice recognition for 
hands-free computer access" (pages 1-7) as applied to claim 1 above, and further in view of Martins, 
U.S. Patent No. 6,608,615 Bl. 

Regarding claims 3, 6, 11 and 14, as discussed in the rejection of claims 1 and 4, Hatfield 
discloses that eye tracking data can be used to control various aspects of the interface for example 
controlling the browsing in internet explorer (IE) and selecting the various items in IE but Hartfield 
does not explicitly disclose the extended applications where the eye tracking data would be used 
such as "determining from the interpretation of the eye tracking data at least a portion of an 
interface that has not been viewed by the user and modifying a format of the portion of the interface 
that has not been viewed by the user". However, Martins which belong to the same field of 
endeavor describes the extended applications where the eye tracking data can be used. Martins 
discloses "if the banner add is not viewed at all, the intervention would cause the banner to 
dynamically appear to jump closer to the user's gaze" thus teaching the limitations as recited in claim 
3. Therefore, it would have been obvious for one of ordinary skill in the art at the time of invention 
was made to combine the teachings of Martins with that of Hatfield as it would enhance the 
capabilities of Hatfield's system to be used in extended applications, thus making Hatfield's system 
more versatile in the field of controlling the interface application using eye tracking data. 
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Examiner note: Examiner has cited particular columns and Une numbers in the references as 
appUed to the claims above for the convenience of the applicant. Although the specified citations are 
representative of the teachings for the art and are applied to the specific limitations within the 
individual claim, other passages and figures may be applied as well. It is respectfully requested from 
the applicant in preparing responses, to fuUy consider the references entirely as potential teachings 
all or part of the claimed invention, as well as the context of the passage as taught by the prior art or 
disclosed by the examiner. 

Any inquiry concerning this communication or earlier communications from the examiner 
should be directed to IManav Seth whose telephone number is (571) 272-7456. The examiner can 
normally be reached on IMonday to Friday from 8:30 am to 5:00 pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, 
Jingge Wu, can be reached on (571) 272-7429. The fax phone number for the organization where 
this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR system, 
see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR system, 
contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 



/Manav Seth/ 
Examiner, Art Unit 2624 
July 17, 2008 



/Jingge Wu/ 

Supervisory Patent Examiner, Art Unit 2624 



